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Abstract 

I> I Using the open quantum system approach apphed to the neutrino 

system, we derive three generations neutrino probabihty formulae con- 
sidering the oscillation induced by mass plus quantum decoherence con- 
■ tributions. The introduction of these dissipative effects is done through 

, the quantum dynamical semigroup formalism. In addition to the the- 

I oretical interest of the approach, at least from the completeness point 

of view, this extension of the formalism to the three flavors, provide us 
with a direct application: we can analyze qualitatively the consistency 
of the two generation pure decoherence solution to the atmospheric 
, neutrino problem, accommodated within this enlarged scheme, with 

the mean tendencies observed for some of the current neutrino exper- 
imental data. This study was performed based on different choices of 



;h ' the 3x3 mixing matrix selected in order to adjust the P^^^y^ to the 

^ same form it has for the decoherence solution in two generations. Our 

qualitative tests for decoherence with three neutrinos show a clear in- 
compatibility between neutrino data and the theoretical expectations. 



Typeset using REVT[t;X 



*Email address: agago@charme.if.usp.br 
^Email address: emoura@charme.if.usp.br 
■l-Email address: teves@charme.if.usp.br 
^ Email address: zukanov@charme.if.usp.br 



1 



I. INTRODUCTION 



In the open quantum system approach |T[, the evolution of a system interacting 
with an environment is described in an effective way, that is, the interaction with 
the environment is incorporated in the description of the evolution of the system. In 
general, the effects produced by the interaction cause dissipation and irreversibility. 
This treatment was originally developed for quantum optics 0, in order to take 
into account the system-reservoir (environment) interaction, and it has already been 
applied to elementary particle systems. Recently, it has also been used in the study of 
two neutrino oscillations modifying the well known oscillation probability, due 
to the presence of dissipative effects. One very interesting feature of the oscillation 
probability in this situation is that even in the case that neutrinos are massless, 
we can have neutrino flavor conversion It has been pointed out that this 

mechanism is able to explain well, in the context of two generations, the atmospheric 
neutrino data collected by the Super-Kamiokande (SK) experiment 0, as long as 
the damping parameter is oc being the neutrino energy. 

The main goal of this paper is to extend this formalism of mass, mixing and 
quantum decoherence to three generations. This is rather well motivated since nowa- 
days the atmospheric and solar neutrino observations can only be explained by 
the introduction of some neutrino flavor conversion mechanism which must be un- 



derstood, specially after the recent impressive SNO results |10], in terms of three 
generations. Therefore, this extension will be very useful, because it will permit us 
to study the decoherence contributions on top of the oscillation induced by mass 
(OIM) in a complete three neutrino context. 

We have developed this three neutrino formalism using the powerful technique of 
quantum dynamical semigroups 0,111 , which makes our analysis independent of any 
hypothesis about the interaction between the neutrino system and the environment. 
Quantum open systems can also be treated using the master equation formalism |0] , 
but in this case, a previous knowledge about the interaction with the environment 
is required. This is an important point since it is not clearly established which is 
the origin of the pervasive medium, the most likely possibilities at the moment are 
quantum gravity effects described by strings at low energy range. In this way, our 
results are broader from the phenomenological point of view. Based on motivations 
coming from the master equation formalism using the weak coupling limit in two 
generations P,^, we have casted the most relevant decoherence effects in a diagonal 
dissipation matrix, as a result we have obtained manageable probability expressions. 

Additionally, as a phenomenological application of this three neutrino extension 
for the decoherence phenomena, we have performed a qualitative study to inspect 
the agreement between the average behaviour of relevant neutrino data and the 
decoherence solution to the atmospheric neutrino anomaly in two generations, em- 
bodied within this enlarged neutrino framework. We have done this study assuming 
different alternatives for the introduction of the two generations decoherence solu- 
tion in our three neutrino scheme. Basically we have divided the study in two parts. 
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On the first part we use only PD to fully describe three neutrino flavor conversions, 
and on the second we deal with a hybrid case, where we assume decoherence plus 
OIM take place in the v^, z/^(^) sector. 

This paper is organized as follows. In Sec. |I| we describe the quantum dynamical 



semigroup formalism for a three level quantum system. In Sec. |IIT| we apply this 
formalism for the neutrino system, explicitly calculating the survival and conversion 
probabilities among neutrino flavors under the influence of decoherence effects. In 
Sec. fV| we analyze the consistence of the decoherence solution to the atmospheric 
neutrino problem in the three generation framework. Finally in Sec. we present 
our conclusions. 



II. QUANTUM DYNAMICAL SEMIGROUPS AND THREE LEVEL 

SYSTEMS 

Hamiltonian evolution, that is, the time evolution of a physical system described 
by the Schrodinger equation in the case of pure ensembles, or by the Liouville equa- 
tion for mixed ones, is a characteristic of systems isolated from their surroundings. 
The time evolution of an isolated quantum system with Hamiltonian H is given 
by the continuous group of unitary transformations Vt = e*^*, where t is the time. 
From the mathematical point of view, the existence of the inverse of the infinitesi- 
mal generator H, a consequence of the algebraic structure of a group, gives rise to 
reversible processes in Hamiltonian systems. 

We know that the time evolution of a quantum open system is characterized by 
the presence of dissipative effects which, in turn, give rise to the irreversible nature 
of the evolution. So, if a given family of transformations should be responsible for 
the evolution in time of a quantum open system, this family will certainly not be 
a group. A rigorous mathematical treatment of quantum open systems is provided 
by the so called quantum dynamical semigroups |in|,|I|. 



The evolution generated by the operators in these semigroups has the property 
of being forward in time, as a consequence of the lack of inverse in a semigroup. 
Physically, this property can be interpreted as the existence of an arrow of time 
which in turn makes possible the connection with thermodynamics via an entropy. 

According to Ref. [0, if TC is the Hilbert space of a given open quantum system, 
and BiH) the space of bounded operators acting on H, the infinitesimal generator 
£, defined through its action on the density matrix p{t), is given by 

Mt) = ^ = -^[^eff, Pit)] + ^ E Pm]] + [AjPit), A}]) , (1) 

where Hes = H + is the "effective" Hamiltonian of the system, H being its free 
Hamiltonian and accounts for possible additional dissipative contributions which 
can be incorporated to H, in other words, which can be put in the Hamiltonian form. 
Aj is a sequence of bounded operators of H {Aj e B{7i)) satisfying Ylj ^ B{T-C). 



3 



The first term in Eq. (|I|) constitutes the Hamiltonian part of the evolution, whereas 
the second term is responsible for the irreversible (non-hamiltonian) nature of an 
open system evolving in time. 

Therefore, if we interpret the last expression as an effective equation describing 
the reduced dynamics of an open system interacting with a certain "environment" , 
the second term in Eq. (|I|), in a certain sense, represents the interaction between 
the open system and the mentioned environment. However, the generator L does 
not depend on a particular interaction, being constructed based on very general 
hypothesis about the time evolution, that is, irreversible dynamics, conservation of 
probability and a less intuitive hypothesis known as complete positivity [|T^,|T|. 

For a N-level system it is possible to construct an explicit parameterization 
of Eq. (P, provided that a suitable basis of B(H), viewed as a vector space, is 
chosen From now on, we will restrict ourselves to a three- level system, whose 
evolution is governed by Eq. (|l|) and our approach will essentially follow Ref. 
The bounded operators in B{T-C) can be represented by 3 x 3 matrices of M^i^C), 
which in turn, can be generated by a basis {F^, fi = 0,1,. ..8}, endowed with the 
scalar product (F^, F^,) = Tr(F^Fy) and satisfying 

(F„,F^) = ^5„^. (2) 

We adopt here the standard basis of hermitian matrices 

i^o = ^l3, Fi = l^i (^ = l,-,8), (3) 

where the Aj are the Gell-Mann matrices [[ Using this choice, Fj's satisfy the 
Lie algebra 

[F,,F,]=tJ2f,,kFk, l<t,J,k<8, (4) 

k 

where fijk are the structure constants of SU{3). Expanding the operators in Eq. (|1|) 
in the adopted basis we get 

MM M 



As pointed out in Ref. , the hermiticity of Aj is a condition that assures the 



increasing with time of the von Neumman entropy S = — Tr(plnp), with this choice, 
the second term on the right hand side of Eq. (|I]) can be written as 



^ There is a standard method of constructing a set of matrices satisfying Eq. (pi) in M„(C) 



111- 



^Prom now on, Greek indices will range from to 8, while Latin indices will range from 
1 to 8, unless otherwise stated. 
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\ E {[^j' p^i\ + [^jP' A-]} = E VPm^-. (6) 

where 

-^/iO = Lq^ = 0, Ljj = 2 E (^"^ ' fimlflkj, (7) 

and in the last equation we have introduced the vectors = {ci^^\ •••) o-^^^ }ofR* 
with the usual scalar product a^-au = J2j of'po.u'^ ■ is a real symmetric matrix, 
defined according to Eqs. (Q) and (0). The elements of L^j, are not totally arbitrary, 
but satisfy some relations due to the presence of the scalar product, which in turn, 
should obey the Cauchy-Schwartz inequality. Introducing the remaining expansions 
of Eq. (I) into Eq. (|l|) we get finally 

Pm = E^iPi/iiM + E^M^P^ ^ = 0,...,8. (8) 

The system of first order differential equations above describes the time evolution 
of a three-level quantum open system. Such an evolution is governed by the laws 
of quantum dynamical semigroups. The physical processes exhibit an arrow of time 
as a consequence of the monotonical increase of the von Neumman entropy as a 
function of time. The evolution also allows the interpretation of the eigenvalues 
of p(t) at any instant of time as the probability of finding the open system in the 
eigenstate associated with the eigenvalue. 

As already mentioned, the theoretical approach provided by quantum dynamical 
semigroups is a very general one to treat open quantum systems in the sense that 
no exphcit hypothesis has to be made about the possible interactions causing the 
loss of quantum coherence. On the other hand, there is another approach to deal 
with systems of the same nature, in which a well defined form of the interaction 
ought to be provided in order to derive the reduced dynamics of the open quantum 
system. This approach is known as the master equation formalism and its rigorous 



mathematical formulation can be found in a series of papers [ p!^ , p!^ , p!^ , p!^ -p2| . Fur- 
thermore, it is possible to show that the master equation formalism applied to an 
open system weakly coupled to some environment leads to an evolution equation 
for the reduced density matrix of the open system compatible of that obtained from 
Eq. (|Tp |]TT|, in other words, in this situation, the master equation and the quantum 
dynamical semigroup formalism are equivalent. 

Coming back to Eq. (||), we see that the differential equation for the po(^) compo- 



nent and conservation of probability imply pQ{t) = y 2/3. The remaining differential 
equations have the form 



^The real nature of its entries can be easily deduced from the hermiticity of Aj. 
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(9) 



which in the matrix form can be written as 

g = Mg, (10) 

so that the formal solution is given by 

g{t) = e^'g{0). (11) 

If {Ai, Ag} and {vi, vg} are the set of eigenvalues and eigenvectors of M, 
respectively, the matrix D, with entries Dij = (vi)j, diagonalizes M, 

M' = D^^MD = dm^(Ai,...,A8). (12) 
Applying the inverse transformation, e'^* = De^'^D"-*^, we get 

P.W=Ee'^*Afc/^fc>i, (13) 

SO that the complete solution of the system of differential equations (H) is equivalent 
to a problem of eigenvalues and eigenvectors. In the case of a matrix of order 8, 
with all non null entries, the solution is too complicated to allow for direct physical 
interpretations. 

III. DISSIPATIVE EFFECTS AND NEUTRINOS 

In this section we present an expression for the probability of neutrino flavor 
conversion assuming that the dynamics responsible by this process is constituted 
by the already known standard OIM mechanism, as well as by dissipative effects 
according to quantum dynamical semigroups. 

A. The probability of conversion 

The hamiltonian H for a free relativistic neutrino with momentum p and rest 
mass m is given by 



if=^p2 + m2, (14) 
so that in the basis of mass eigenstates 



^Note that g p, the first being a column vector with components pk- 
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pWk)=PkWk) and m|z/fc) = mfc|z/fc), (15) 
and we can write for relativistic neutrinos {p = |p|), 

Hr~.p^ + ^^ {uk\H\ui) = 5ui [pk + ^) . (16) 

The expansion of H in the basis is 

^ = ^/l + ^ + ^ (^""'2) + ^ (^""'^^ + ^""'3) ^^^^ 

where = ''^1 + '^i + ^3 and Am^^ = mf — m^, 2,7 = 1,2, 3. 

As aheady mentioned at the end of the preceding section, an analysis considering 
the most general form of M would certainly not provide information subject to 
direct physical interpretation. From this point of view, its reasonable to begin the 
analysis introducing simplifications which allow a direct physical interpretation of 
the results. Of course, these simplifications cannot be completely arbitrary, because 
all the physics depends on them. In this way, motivations coming from the formalism 
of master equation, in the so called weak coupling limit, applied to the problem of 
neutrino flavor conversion in the two generation case [^], lead us to assume a diagonal 
matrix L^^, that is, 

[L^^] = diag{0, -71, -72, -73, -74, -75, -76, -77, -73), (18) 
where the diagonal elements are given by 

li = La = — - ^ (am ■ ak)fimifiki- (19) 

k,l,Tn 

In the case of two generations, the diagonal form of L^^^, can be deduced via the 
master equation formalism in the weak coupling limit, provided that a gas of quanta, 
satisfying infinite statistics (for example a DO-brane) is adopted as the dissipative 
medium. These quanta should also be in thermodynamic equilibrium at a finite 
temperature f3 = 1/M, where M defines an energy scale at which the dissipative 
effects are believed to become important (possibly the Planck scale if the effects 
have quantum gravity as their source). The diagonal form is finally obtained if one 
further imposes the condition of entropy increase for finite /3, for details see Ref. 0. 
We stress that here Eq. (|18D is just an Ansatz motivated by the results in the two 
generation case. 

Using this parameterization of L^^, we can construct the matrix M defined in 
Eq. (|^), and its eigenvalues and eigenvectors can be obtained. The explicit form of 
M, its eigenvalues and associated eigenvectors can be found in Appendix 0. 

If at t = a neutrino of flavor is produced, the probability of its conversion, 
after a time t, to a flavor z/^ can be written as 
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1 1 



-1 ^a/'n^ 



(20) 



In a more explicit form, the probability of conversion can be written as 



P, 



it) 



1 1 

3 2 



'2Ai2 (, 



{PlP^l + P2 Pf ) 



e 2+62 



P?P2-P2Pf)+A7l2 (P?pf-Pfpf 



+ 



(P4pf + P5 Pf 
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e 2+62 



+ 



'2Ai3 (p^pf - pgp ^) + A745 (p2P4 - 

(PePe +P7P7 
'2A23 (p?p^ - p?p^) + A767 (p?p? - p?p^ 



23 



+ e-^^'Va P3 + e-^^VsPf 



"12* ni2t ■ 
e 2—62 



6 2 — 6 2 



^23* ^23* 
6 2—62 



g-|(7i+72)t 



g-f (74+75 



e 2 



I (76 +77)* 



(21) 



where A7jj = 7^ — 7j and the definition of the new variables Qij can be found in 
Appendix 0. 

It is easy to verify that: Eq. ( pl|) exhibits conservation of probability at any 
instant of time; reducing the number of dimensions from 3 to 2, we get the results 
for decoherence in two generations 0; and in the limit 7i— >0(l<z<8), the 
standard OIM mechanism is recovered. 



IV. PHENOMENOLOGICAL APPLICATION 

In this section we will use the just developed three neutrino framework for OIM 
mechanism plus the decoherence effects, to analyze the robustness of the decoherence 
solution to the atmospheric neutrino problem in two generations envisaged within 
this enlarged scheme. This will be done for different selections of the mixing matrix, 
first for PD and second for decoherence plus masses and mixing. 



A. Pure Decoherence 



In order to obtain the probabilities that correspond to the PD case it is enough 
to eliminate the usual oscillatory terms. This can be easily done by setting the 
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mixing matrix U equal to the unity matrix. Applying this to Eq. (^) we get the 
following expressions: 



.ufsy ^ 3 ' 2 
where a, P = e, /i, r, so consequently 



Pit. At) = 1 + ^(e-^^VsPf + e-^^VsP^), (22) 



pPD 

i^e — 




1 1 


-73* 


pPD 


..w = 


1 1 




pPD 




1 1 

e 

3 3 


-78* 


pPD 


..(^) = 


1 1 

3 + 2^" 


-73* 


pPD 




1 1 

e 

3 3 


-78* 



+ (23) 



+ Fe-^«*, (24) 
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(25) 



+ le-^'\ (26) 
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(27) 



Despite the fact that mixing is not included, we can observe from these probabil- 
ities, that it is possible to have non-null neutrino flavor conversion only taking into 
account the decoherence phenomena. Indeed, these results were expected, since the 
same was obtained in two generations 0]. 

The atmospheric neutrino data can be interpreted well using the PD phenomena 
in the two generation framework 0. Thus, we can investigate if the pure decoherence 
mechanism extrapolated to three generations is still able to explain the current data. 
A qualitative analysis of the behavior of the above probabilities in the present data 
context can clearly demonstrate that this is not so. The explanation goes as follows. 

Since we aim to test the decoherence solution to the atmospheric neutrino data in 
the three generations scheme, we will have to consider the damping parameters with 
the dependence •jj jj/Eiy, in accordance with the two generations assumption. 
Thus, the probabilities defined in Eqs. (p3D -(p7D will be sensitive only to the ratio 
L/Ey 1^ similar to vacuum case for the OIM mechanism. Here L is the distance 
between the source of neutrinos and the detector. Note also that these probabilities 
will not be modified by the presence of matter, since there is no mixing involved. 

The conjunction of all of these properties of the probabilities with the fact that 
Pue^ue = Puf,~>u^, makcs the three neutrino PD mechanism incompatible with the ac- 
tual neutrino data. One can exemplify this inconsistency by confronting the results 



of the neutrino experiments CHOOZ p3| and K2K p4| with our theoretical predic- 
tions. Both experiments have similar L/E^, but their results for Pu^^ue P^^c^Uf, 
are not compatible with our theoretical expectation. The CHOOZ experiment with 



In our formulae you can make the substitution t ^ L (for c=l). 
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{L/ES) ^ 1000/3 (m/MeV) observed {Pu.^v,) ^ 1 Q and the K2K experiment with 
(LjEy) ^ 250/1.3 (km/GeV) has observed events compatible with {Pu^,^u^) ~ 0.7. 
Therefore the relation Py = Pu^^y^ given by our probabilities, is in contradiction 
with the resuhs of CHOOZ Ind K2K. 

Another example that reinforces this contradiction is the multi-GeV SK data 
sample |^| in combination with the CHOOZ constraint. In order to illustrate this 



fact, we consider the SK normalized e-like and /x-like event samples, which can be 
computed as follows 

R, = {Pu,.^.;) + \{Pu.^u,). (28) 

i?e = (P..^..)+r(P.,^.,), (29) 

where and Re are the normalized //-like and e-like event samples defined as 
the ratios of the expected number of events considering neutrino conversion over 
the expected number of events without neutrino flavor conversion, r is the original 
proportion between the muon and electron neutrino fluxes. We can observe that 
for ranges of {L/EJ) ?a 1000/3 compatible with CHOOZ and corresponding to 

cos^^enith 0.22 [| in the multi-GeV sample, {Ey) ^ 10 GeV |2§, i?^ = 0.6 - 0.7 

and Re = 1. Thus, crossing this information with the CHOOZ bound, we find that 
(Pu^^ue) = (Pue^u^) ~ (in fact, for a real mixing matrix, Py^^y^ = Pu^^uc, as can 
be seen from Eq. (pT])) and consequently {Pu^^u^) ~ 0.6 — 0.7, which is again in 
conflict with our theoretical prediction. 



B. Decoherence Oscillation 



Here we will study two different cases also admitting the presence of the oscilla- 
tory terms in the probability expressions, therefore we have here a mixed situation 
of decoherence oscillation (D0O). In both cases the oscillation will be included 
through non-null mixing matrix elements, which connect Ue with i/^ or Ue with i/^. 
This is chosen in order to preserve the possibility to explain the solar neutrino data 
through of the OIM mechanism. In addition, another fact in our strategy of analysis 
will be to adjust the parameters in the Py^-,y^, the leading channel for the expla- 
nation of the atmospheric data, to be similar to its form in the two generations 
decoherence solution to the atmospheric neutrino problem. 



^The probabilities defined in Eq. ( |2l| ) satisfy Pp^^y^ = Py^^y^. 

^The relation between the cos ^zenith and L is given by L = y/ {Rt + /i)^ — {Rt sin QzY — 
Rt cos6'zenith) where Rt is the earth radius and h is the height of the neutrino production 
point. 
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When we introduce non-zero masses for the neutrinos, two different situations 
may arise according to the magnitudes of Ajj and /^"iki- either 2|Ajj| > |A7fci| or 
2|Ajj| < |A7fci|. In our analysis we will assume the first situation, where VLij is 
imaginary so that Eq. ( pT] ) takes the form 



+ 



+ 



+ 



+ 



+ 



PiPi +P2P2 COS 



2Ai2 - P2P1) + A712 {p?P^ - P^p'2 



{P>i + P5 Pf ) COS I 

'2Ai3 {p2p^,-ptpl 



^12 



+ A745 (p^pf - p?pf 



^\^2z\t^ 



(PeP^ + P?P?) cos 



'2A23 (p^p^-p^p^)+A767 [p1 



P a 13 

Pi - PrPj 



a 



23 



sm 



sm 



sm 



\^23\t^ 



^-3(71 +72)* 



4(74+75)* 



e 2 



5(76+77)* 



+ e-^^VsPf + e-^^Vs P^ 



(30) 



In the case 2|Ajj| < |A7fci|, we would have an analogous expression, but with 
hyperbolic sines and cosines. 



1. Mixing in the t'g-f/i sector 

In this case we switch on only the non-null mixing matrix elements in the z/g-t'^ 
sector, so that the mixing matrix is defined as 

/ cos 6 sin 6' \ 
U = -sine cose . (31) 

V 01; 

Due to the form adopted for the mixing matrix, oscillatory terms will not appear 
in the transition probability between Ur and the other flavors, remaining only the 
decoherence terms for generating non-zero neutrino conversion related to z/^- 

The survival and conversion probabilities of interest for the case 2|Aij| > |A7fc;| 
can be explicitly built now and are given by 
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p. 



Deo 



1.^1 ■ 2oJ l\^12\t 

— — sm 16 cos 

3 2 [ V 2 

+ -cos2 2^e-^^* + -e-^»*, 
2 6 



, A712 
+ — — 7 sm 



12 



sin^ 26 



COS 



1 1 

3 ~ 2 



--cos^ 25e-'^«* + -e-^«*, 
2 6 

3 3 ' 



, A712 
+ — — 7 sm 



e 2 



5(71+72)* 



12 



e 2 



5(71+72)* 



jD©0 



1 1 9 . 

- + - sin^ 2^ 
3 2 



COS 



3.D®0 



it) 



+ -cos^ 26e 
2 

1 1 

3-r 



-73* 



2 

-78* 



, A712 

+ — — 7 sm 



I^^12|t' 



\n 



12 



e 2 



5(71+72)* 



-78* 



(32) 
(33) 

(34) 
(35) 

(36) 
(37) 



and analogous expressions can be written for the case 2|Ajj| < |A7fci|, through the 
substitutions cos cosh, sin — > sinh. 

Once we have defined these probabihties we will check their consistency with the 
tendency indicated by the atmospheric neutrino data. Our test will be based upon 
the definitions for the normalized e-events and /^-events given in the Eqs. (p8|) and 

Since our probabilities involving mixing with are going to be applied for the 
atmospheric neutrino data, matter effects must be considered. This is because the 
atmospheric neutrino data involve neutrinos which travel different distances through 
the Earth. The inclusion of matter effects in the probability expressions is really 
straightforward in the case where constant matter density is considered 0]. Basically, 
we only need to replace 6 ^ 6m (in the corresponding sines and cosines), and 

Ai3 



A^ where 



sin^ 26*^(3^) 



sin^ 26 



sin' 26 + {x-cos26)^' 



(3^ 



and. 



Am 
^13 



sin^ 26 + {x- cos 2^)2 Ai3, 



where x is given by 



X 



2V2Gpn,E, p(gcm-3) E,(GeV) 

- ~ U.YD 



Amfg 



Amf3(10~4 eV^ 



(39) 



(40) 



Gi? is the Fermi constant, the electron number density, E^, the neutrino energy 
and p the matter density. 
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For evaluating how these matter effects affect our probabihties, we will choose 
the following values for the relevant parameters: Am^g < 3 x 10~^ eV^, consistent 



with the large mixing angle (LMA) solution to the solar neutrino problem |27 
El, ~ 10 GeV, consistent with the mean neutrino energy for multi-GeV events, and 
p(gcm~^) ~ 2.75 ||2^, this value is one of the lowest values in the Earth matter 



density profile. Using these values we estimate that sin^ 29m — ^ and cos^ 29m — ^ 1- 
Note that this will happen even faster for higher values of matter density. As a 
result, we can write simplified probabilities for this case 

PuMit)^l + (41) 

^^^^ 
(43) 

here we go one step further and assume — > 0, 

pzt%(')=l+y''\ (44) 



thus we mimic completely the two generation expression for decoherence in 

At this point we have Pu^^u^ = Pu.^ue = Pi^e^u^ = I - P and P^^^ur = 
Pu^^u^ = 0. Writing Eqs. (|28|) and (^) as a function of P, we obtain 

R,= (i- I) {P) + (45) 



R^= (1- r) (P) + r. (46) 

Now we can check, in a model independent way, the consistency of these expres- 
sions with the atmospheric neutrino observations. To make an analysis consistent 
with our assumption on the neutrino energy, we will look at the tendencies of multi- 
GeV events, this implies r ^ 3. The e-like multi-GeV events are consistent with 
Re — I for any neutrino trajectory, so that 

Re = -2{P) + 3-1 (P) ^l, (47) 

and consequently, 

R, = l{P) + l^l, (48) 

which is in strong disagreement with the behavior of neutrinos coming from below 
the horizon, since /i-like multi-GeV events are indicating in average that i?^ ~ 
0.5 — 0.6. Therefore this case is also in conflict with the present data. 
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2. Mixing in the Ve-'^r sector 



In this case we turn on only the mixing matrix elements that connect Ve-Vr-, 
which implies the following mixing matrix 



U 



I cos 6 sin 6 

10,, 
y — sin 6 cos 6 



(49) 



so that the mass induced oscillation terms do not appear in any transition involving 
Then, for the case 2|Ajj| > |A7fci|, we obtain the probability formulae 



)DffiO 



it) 



pDeo 



lit) 



11 4 
COS 

3 2 

+ -sin2 29 
2 

1 1 2 
COS 

3 2 
1 1 



+ -(cos^^ - 2sin^y)"e 
6 



cos 



, A745 



131 



e 2 



I (74+75)4 



1 

6' 



+ -(cos^^ -2sin2^)e-^«*, 



- -r - cos^ e sin^ ^e"^«* + - (cos^ 9-2 sin^ 9) (sin^ 9-2 cos^ 1 



— sin^ 29 
2 



COS 



A745 . \^l-i\t 



1(74 +75)* 



3 2 6 ' 



sm 

3 2 



+ -(sin^^ - 2cos' 
6 



2 fl\2g-78i 



(50) 
(51) 

(52) 
(53) 
(54) 

(55) 
(56) 



and once again, the case 2|Ajj| < \/^'~iki\ can be obtained just by substituting the 
harmonic functions by their hyperbolic partners. 

Before analyzing the probabilities in this case, we will make some further assump- 
tions. First, we will take 3x 10"^ < Amfg/eV^ < 19x 10"^ and 0.25 < tan^ 9 < 0.65, 
both consistent with the LMA solution to the solar neutrino problem second 
we will neglect all the decoherence parameters for the L/E^ at the range of the at- 
mospheric neutrino scale, with the exception of 73, which is needed in order to make 
Py^^y^ similar to its form in the decoherence solution to the atmospheric neutrino 
anomaly in two generations. 

Once we have accepted these assumptions, we can study the compatibility of 
these probabilities with the current data. We will not use the atmospheric neutrino 
data to test the viability of the decoherence solution in the three generations scheme. 
This is because the probabilities are written as a function of cos 9 and sin 9, which 
makes it difficult to extract correct conclusions without introducing refinements to 
the qualitative analysis we have used up to now. Instead, we will simply look at 
CHOOZ data. This will be enough to give us a good idea about the compatibility of 
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the decoherence solution in the three neutrino scheme, through the observations in 
the channel Ve ^ ^e- Since we are going to use for this study P^^^^^, it is convenient 
to write it down after the assumptions mentioned above are taken into account 

pDeo ^ i + i 1^^054 Q^-r,L/E. ^ ^-^2 2Q cos(Ai3L)) + -{cos^ 6-2 sin^ 6f. 

(57) 

We have obtained excluded regions in the plane (cos^6',73), with 73 = •y^/Eiy, 
following the statistical procedure described in Ref. p. We must point out that 
variations in Am^g will not affect these excluded regions, since cos(Ai3L) ^ 1 in 
the CHOOZ range. 

The results are shown in Fig. |l], where the points to the right of the contours are 
excluded. We observe that the point in this plane which corresponds to the value 
of the decoherence parameter which best explains the atmospheric neutrino data, 
73 = 1.2 X 10^^^ GeV^, as well as cos^ 6 which corresponds to the best fit value for the 
LMA solution to the solar neutrino problem, cos^ 6' ^ 0.73 (sin^ 26' ^ 0.8), denoted 
by a black dot, is excluded at 99 % C.L. In general, if cos^6' > 0.5 we can exclude 
7* < 7.0 X 10-22 GeV2 at 99 % C.L. In this way we observe that CHOOZ data 
also highly disfavor this three neutrino scheme, since it excludes a large region of 
73 compatible with the atmospheric neutrino solution for values of cos^ 6 consistent 
with the LMA solution to the solar neutrino deficit. 



V. CONCLUSIONS 

Under the assumption that the neutrino system can interact with a pervasive 
environment, we have obtained neutrino probability formulae for three neutrino 
generations, taking into account quantum dissipative effects coming from the inter- 
action with the medium on top of the OIM mechanism. The damping terms were 
brought in through the quantum dynamical semigroup formalism. This approach is 
very useful, since no a priori assumption on the form of neutrino-medium interac- 
tion has to be made. Some simplifications of the form of the dissipative matrix were 
adopted based on results in two generations. 

We have performed a qualitative analysis to test if the two generation deco- 
herence solution to the atmospheric neutrino problem viewed in this hybrid three 
neutrino framework, can still explain the tendencies of the current experimental 
neutrino data. 

We have analyzed two different cases, the first one considering only PD and the 
second including a mixture of both conversion mechanisms, that is, decoherence plus 
OIM. The second case was further subdivided into two cases, according to the choice 
of mixing matrix: i) mass and mixing contributions connecting z/g — > z/^; ii) mass and 
mixing contribution connecting Ue Vt- We have observed that all of these cases 
are clearly disfavored by recent relevant experimental neutrino data. Particularly, 
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in the PD case, the fact that P^^^ue = Pu^^Uf, is not compatible with the constraint 
given by CHOOZ combined with SK data {Re and i?^) or with K2K results. For 
the hybrid case of decoherence plus non-null mixing in z/g ^ z/^, the same prediction 
Pue^i^e — -^v arises which is clearly not supported by SK data. In the case of 
decoherence plus mixing in Vf. z/^-, we have made a statistical analysis of CHOOZ 
data using our theoretical expression for Py^^y^, with some simplifications. We have 
obtained that the best fit value for the decoherence solution to the atmospheric 
neutrino problem, 73 = 1.2 x 10^^^ GcV^, is highly disfavored by data. Values of 
73 > 3. X 10~^^ GeV^ for cos 9 consistent with the LMA solution to the solar neutrino 
deficit are, in general, excluded at 99 % C.L.. 

Although, the tests we have performed in the three neutrino scheme indicate a 
disagreement between data and theoretical expectations, this does not mean that 
dissipative effects can not exist as subleading processes, with the full three neutrino 
OIM as the main mechanism for neutrino flavor conversion. In fact, the formulae 
developed here arc interesting to be used to help establishing limits on the decoher- 
ence parameters or to try to detect their effects using an appropriate three neutrino 
description. 

Also it is worth to stress that we have worked here in a simplified situation in 
which the dissipative matrix is diagonal. The presence of off-diagonal terms can 
certainly produce interesting effects on the probability expressions. Our formulae 
can be easily modified to include these off-diagonal terms. However, any further 
qualitative or quantitative analysis in three generations will not be so direct. 
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APPENDIX A: EXPLICIT FORM OF M 



We present here the exphcit form of the matrix M, its eigenvalues and eigen- 
vectors, as well as the diagonalizing matrix D and its inverse defined in Eq. ([l2|) . 
Starting from the definition of M in Eq. @, taking as valid the approximation 
Hes H M, we can write 



M 
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-Ai2 
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-A23 
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-77 
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-78 / 



with the definitions 

h-i = A12, hi 



:(Ai3 + A23) and A, 



Now solving the secular equation det(M — Al) = 0, we get 



, i,j = 1,2,3. 
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The associated eigenvectors are in turn 
T / Al + 72 



, A12 
'A2 + 72 



A 



,1,0,0,0,0,0,0 



, 1,0,0,0,0,0,0 



12 



(Al) 



(A2) 



(A3) 



(0,0,1,0,0,0,0,0) 
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0,0,0,^^^^,1,0,0,0 



0,0,0, 



Ai3 

A4 + 75 



(A4) 



,1,0,0,0 



^13 



0,0,0,0,0, ^^"'^ 1,0 



i23 



v?^= 1^0,0,0,0,0,^^^,1,0^ 

vj = (0, 0,0,0,0,0,0,1), 

where the superscript T denotes transposition. One can now construct the diago- 
nahzing matrix D and its inverse 
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APPENDIX B: EXPLICIT FORM OF THE COEFFICIENTS 

Flavor cigcnstates |z/q), a = e,^,r can be written as a function of mass eigen- 
states k — 1,2,3 through a unitary matrix U 



Wa)^Yl KkWk) and Yl UkpUl^ = UpkKk = Sap, 



k=l 



k=l 



k=l 



we can express the density matrix of a flavor state lu^) as 



\fc=l / \fe=l / 

= Y KkUalH){l^l\. 
k,l=l 

In the mass eigenstates basis we have 



(Bl) 



Wmlp'^Wn) = Y U*kUal{l^mWk){l^lWn) = U^JJan, 
k,l=l 



(B2) 



so that 



a3 



Therefore, the coefficients = 2Tr[p"F^] can be exphcitly written as 
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FIG. 1. Regions in the plane (008^^,73) excluded by CHOOZ data. The black point 
denotes the best fit value for the decoherence solution to the atmospheric neutrino prob- 
lem, 7I = 1.2 X 10^^ GeV^ as well as for the LMA solution to the solar neutrino one, 
cos^ 0.73. All points to the right of the curves are excluded at 90 % (continuous line) 
and 99 % (dashed line) C.L. 
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